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ABSTRACT 



A method and system for archiving digital data on a server 
computer, and enabling a user, by means of a client 
computer, to interactively view a digital image derived from 
the digital data, the method including receiving an original 
HTML page by the client computer from the server 
computer, the original HTML page containing a view win- 
dow within which a first image is displayed, the view 
window being partitioned into a plurality of sub-regions at 
least one of which contains a multiplicity of pixels, selecting 
a location within the view window corresponding to one of 
the plurality of sub-regions by the user, initial sending by the 
client computer to the server computer an indication of the 
sub-region selected by the user, creating by the server 
computer a new HTML page containing a link to an embed- 
ded image which corresponds to the indication, and further 
sending the new HTML page by the server computer to the 
client computer. 
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METHOD AND SYSTEM FOR HTML- or a stand alone application. Each form has its relative 

DRIVEN INTERACTIVE IMAGE CLIENT advantages. For example, plug-ins can be developed full- 
scale C++ programs, offering a great deal of functionality, 

The present invention relates to the interactive viewing but ^ ^so require separate installation and are native to 

of images over the Internet. This application is a 5 a specific platform. Java applets, on the other hand, auto- 

contmuation-in-part of U.S. patent application Ser. No. matlcaU y d u own * oad server mstall themselves, 

08/979,220 filed Nov. 26, 1997. W red *?y the HTML page, and are cross-platform 

^ J interoperable, but Java code is more restricted than C++ and 

MICROFICHE APPENDIX performs more slowly. Typically, client software is used as 

a player or viewer for special multimedia types, such as 

A microfiche appendix forms part of this application and audio, still image and video, that are embedded in the HTML 

includes Appendix A and Appendix B. Appendix A and pages. 

Appendix B are described below in a section captioned Similar to client software, server software can also be 

"LIST OF APPENDICES". native to a specific platform or Java. Topically, server 

software is used for special access to files stored on the 

FIELD OF THE INVENTION 15 serverj and for cxtra processing of data before sending it. 

m «„™™^r There is often a trade-off between pre-processing data on the 

BACKGROUND OF THE INVENTION server sMe before sending it to ^ , or * having the 

Internet browsing is implemented through client client process it after the data is received. In extreme cases, 

computers, HTTP server computers and HTTP browsers. an application can be designed with server software doing 

Server computers, also referred to as "servers," play the role 20 a11 of th * processing, and no client software at all; or vice 

of archives for commerce, education and entertainment, and vetsa > t software doing all of the processing, and no 

client computers, also referred to as "clients," play the role si ™ softw » re * f. ach choice J" s J* ^ 

- . * 9 . r r / advantages. On the one hand, client computers are typically 

of customers or consumers. Typically many clients connect { J QrM aod have less resources tha i server computers, 

to a single server Special server and client software may mdic F atin an advantage to letting the server do the extra 

also be employed, depending on the specific application processing . 0n the other hand, servers have to simulta- 

design architecture. neously handle many clients, and any drain on server 

An Internet browser, such as Microsoft's Internet resources inhibits response time to clients, indicating an 

Explorer or Netscape's Communicator, is a piece of soft- advantage to letting the client do the extra processing, 

ware which resides on a client computer. When executed by 3Q The ac tual data communication between the server and 

a user, the browser opens a Uniform Resource Locator the client is governed by Internet protocols, such as Hyper- 

(URL), which resides on a server computer. Typically, the Text Transfer Protocol (HTTP) and Interact Imaging Proto- 

URL is a Hyper-Text Markup Language (HTML) page, to1 (rip). These protocols define packets of data to be sent, 

which is sent back from the server to the client computer. an( j can include handshakes for negotiating data-link 

The HTML page has instructions for the browser, which 35 control, to verify if the data arrived intact. Specifically, the 

instruct the browser how to render the page for display. The up pro t 0 col sits as a layer on top of the HTTP protocol, 

page typically has additional URLs embedded in it, and which in turn sits as a layer on top of TCP/IP protocol Eacb 

when the user clicks on one of them, the server then sends higher layer is higher level in its functionality; i.e. it deals 

a new HTML page for the browser to render. with more complex data units and communication features. 

HTML pages can contain both text and graphics, along 4Q A reference for HTTP is the text "Illustrated Guide to 

with layout instructions. Images appearing on an HTML HTTP" by Paul S. Hethmon © 1997 Manning Publications 

page also reside on the server computer, and are sent to the Co., Greenwich, Conn., 1997. A reference for the IIP is the 

client when the browser finds a link to an image on the document "Internet Imaging Protocol," ©1997 Hewlett 

HTML page it is rendering, and then instructs the server to Packard Company, Live Picture, Inc., and Eastman Kodak 

send the image data. The beauty of this is that the images 45 Company, the contents of which are hereby incorporated by 

reside on remote computers, and do not have to be stored reference. 

locally on the client. Otherwise, the client would have to One of the most challenging Internet applications is 
store every image it views, either on its hard disk or on a interactive viewing of images. Specifically, a large image, 
storage medium such as CD-ROM, regularly replacing these f or example, a 360 degree panoramic vista, is stored on a 
images with updates. Memory limitations would severely 50 server, and selected portions to be viewed are sent to a client 
limit the number of images the client can browse, as m response to user navigation commands. As the user pans 
compared with the unlimited number available on server left, right, up and down, and zooms in and out of the 
computers today. HTML pages can also contain links to panorama, the server sends the necessary image data to the 
programs to run — for example, Java applets. client for rendering the appropriate view, thus providing the 
HTML pages can be either static or dynamic. Static pages 55 user with a smooth navigational experience. Effectively, the 
are fixed once and for all, and every time the browser server enables the user to inspect the image interactively, 
accesses such a page, the same page is sent. Dynamic pages Most challenging are images having large information con- 
are adaptively created by special software residing on the tent. The sizes of these images can be as large as hundreds 
server. In this scenario, when the client accesses such a page, of megabytes, depending on the resolution and color depth, 
a program executes on the server which generates an HTML go making it impractical to simply transmit the entire image 
page on-the-fly. This page is then sent to the client. A from a server to each client. 

dynamic page can be different every time it is sent to a client. Another common type of media which is viewed by 

This feature enables a web designer to offer a more custom- interactive navigation is large still images, which are larger 

ized experience, but requires special server software for its than the display resolution of a monitor. Ihe user can only 

implementation. 65 view a portion of the image at any given resolution, but is 

Client software can take many forms, such as that of a able to navigate in all four directions and zoom in and out 

plug-in for the browser, an Active-X control, a Java applet interactively, in order to inspect details of the full image. 
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Implementations of interactive server/client image navi- SUMMARY OF THE INVENTION 

gation can vary. Good strategies involve (i) deciding ^ n , inventia|1 ides a novel appl0ach to c]i - 
whether or not to use special server and client software (u) mteractive image navigation over the 

smart caching of data which will be re-used, (m) use of data h ^ ^ 

compression, (lv) use of special data communication 5 . . ? * n ^ «= • * u- 

protocols, (v) user interface design, and much more. One Jf ^signedin such j way as tc .allow for efficient caching on 
approach, based on assignee's co-pending U.S. patent appli- ^th the client and server sides, so as to reduce network 
cations Ser. No. 08/788,830, filed Jan. 6, 1997 and entitled latenc y for the chent md also boost server Performance. 
METHOD AND SYSTEMS FOR SCALABLE REPRE- The invention operates by partitioning the view window, 

SENTAITON OF MULTIMEDIA DATA FOR PROGRES- 10 in which the client is displaying changing images as the user 
SIVE ASYNCHRONOUS TRANSMISSION, and Ser. No. navigates. The window region is partitioned in a number of 
08/813,181, filed Mar. 7, 1997 and entitled METHOD AND sub-regions. These sub-regions are typically not visible to 
SYSTEM FOR ENCODING MOVIES, PANORAMAS the user. Whenever the user clicks on the image being 
AND LARGE IMAGES FOR ON-LINE INTERACTIVE displayed, the browser sends the mouse pointer coordinates 

VIEWING AND GAZING, uses no special server software, 15 back to the server. The server then calculates which sub- 
This approach streams the image data in background, and region these coordinates belong to, and dynamically embeds 
enables the user to navigate through whatever image data a corresponding response image into the HTML page being 
has arrived at the client. A second approach, based on returned to the client. In effect, the user navigation is being 
assignee's copending U.S. patent application Ser. No. "quantized" into a number of possible responses. Typically 

08/850,690, filed May 2, 1997 and entitled A METHOD 20 this number is small (less than 10), and correspondingly, for 
AND SYSTEM FOR PROVIDING ON-LINE INTERAC- each image currently being displayed, there are only a small 
TIVITY OVER A SERVER-CLIENT NETWORK, uses number of different images for display in response to user 
special server software to serve up only the specific image navigation. 

data necessary to satisfy the user's request. A third approach, The server's role is simply to identify which of these 

based on assignee's co-pending U.S. patent application Ser. ^ images is to be displayed in response to a specific interactive 
No. 08/850,787, filed May 2, 1997 and entitled A METHOD user command, and to prepare that image in a form that the 
AND SYSTEM FOR PROGRESSIVE ENCODING IN AN browser recognizes, such as JPEG. A primary advantage of 
ACTI VE DESKTOP ENVIRONMENT, combines both of this form of quantization is that typically the user will return 
the abovementioned approaches by using a push mode to to the same image over and over. Thus by caching these 

stream image data in background, together with a pull mode 30 images within the client, the client provides an instant 
to request specific image data. The contents of the patent interactive response whenever the user navigates back to the 
applications referred to in this paragraph are all hereby same image. Moreover, by caching these images within the 
incorporated by reference. server, redundant processing for multiple clients can be 

HTML-driven clients for image navigation are known. eliminated, enabling the server to respond quickly to many 

The user navigation is implemented on the client side by 35 clients simultaneously. 

means of dynamic HTML features, obviating the necessity The present invention also enables a client to interact with 
of using any special client software, and making this what is an image without the use of image maps, by selecting one of 
referred to as a client-less architecture. The term "client- several commands, such as "zoom-in," "zoom -out," "pan," 
less" refers to the absence of special chent software. HTML and "reset." The command selected is embedded within an 

has a feature called image maps, which enables the browser 40 HTTP request dispatched from the client to the server, which 
to send back to the server the coordinates within an image the server can parse to extract the selected command. The 
corresponding to the location of the mouse pointer when the server uses this command to modify the HTML page, in 
user clicks on the mouse. This information is used by special order to update the image reference contained therein in 
server software to generate an HTML page in response to the accordance with the selected command. For example, a 

user interaction. 45 "zoom-in" command can be used to effect a centered 

As described above, static HTML pages were the first and magnification, by a factor of two, of an image being 
are still the most predominant mode of client/server inter- displayed, and a "zoom-out" command can be used to effect 
action. Dynamic HTML^driven clients for interactive image a centered reduction, by a factor of two, of the image, 
navigation was implemented by Kodak in its PixFactory Similarly, a "pan" command can be used to translate the 

FLASHPIX® application, as described on the web page 50 image being displayed by a fixed pre-determined amount, 
http://www.informix.com/informix/bussol/iusdb/dbtech/ such as half of the width or height of a display window, 
sheets/kpfdm.htm and by New Mexico Software in its A key feature of the present invention is that it operates 

IMAGE ASSETS server, as currently demonstrated on its without the use of special chent software, other than an 
web site at http://www.image-assets.com/cgi-bin/fpiarea.pl/ Internet browser which is already resident on the client 

image=01_l.fx/user=demo 55 computer. It enables a server to provide response image data, 

The drawback with this client-less approach to image in response to a user clicking within an image being dis- 
navigation is that it is very processing-heavy on the server played or clicking on a command button, entirely by means 
side. For every interactive user command, the server has to of HTML pages. In particular, a user connected to a web site 
render a customized image to embed in the dynamic HTML employing server software operative in accordance with the 

page. Given the rapid pace with which interactive user so present invention, can automatically interact with ^ images on 
commands are issued, this puts a heavy burden on the server, the site without the need to download client plug-in software 
greatly slowing down its performance. Moreover the com- or a client Java applet. 

bined latency of the server processing and the network There is thus provided in accordance with a preferred 
communication makes the user experience a "bumpy" rather embodiment of the present invention a method for archiving 

than a "smooth" interactive experience; i.e. the navigation 65 digital data on a server computer, and enabling a user, by 
experience appears more like a slide show than a continuous means of a client computer, to interactively view a digital 
animation. image derived from the digital data, including receiving an 
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original HTML page by the client computer from the server Moreover in accordance with a preferred embodiment of 

computer, the original HTML page containing a view win- the present invention the sequence of commands forming 

dow within which a first image is displayed, the view part of the IIP includes a region (RGN) command, 

window being partitioned into sub-regions at least one of Additionally in accordance with a preferred embodiment 

which contains a multiplicity of pixels, selecting a location 5 of th(J n , inventioD me nce of commands forming 

withm the view window corresponding to one of the sub- rf ^ np a M (ym command 
regions by the user, initial sending by the client computer to 

the server computer an indication of the sub-region selected Further in accordance with a preferred embodiment of the 

by the user, creating by the server computer a new HTML present invention the sequence of commands forming part of 

page containing a link to an embedded image which corre- 1Q the IIP includes a height (HEI) command, 

sponds to the indication, and further sending the new HTML Still further in accordance with a preferred embodiment of 

page by the server computer to the client computer. the present invention the digital data is a tiled multi- 

Moreover in accordance with a preferred embodiment of resolution image file, such as a FLASHPIX® image file, 

the present invention the selecting step includes positioning Moreover in accordance with a preferred embodiment of 

a pointer of a mouse input device on a pixel within the view J5 th e present invention the embedded image is built from tiles 

window, and clicking on the mouse input device. within a multi-resolution image file, such as a FLASHPIX® 

Additionally in accordance with a preferred embodiment image file, 

of the present invention the indication is the location of the ^ also prov ided in accordance with a preferred 

pixel pointed to by the mouse input device. embodiment of the present invention a method for interac- 

Further in accordance with a preferred embodiment of the 2 o tive viewing of a digital image by a user, the viewing being 

present invention the method also includes the step of controlled by a client computer, employing digital data 

identifying that one of the sub-regions within which the residing on a server computer, including receiving an origi- 

pixel location is situated. na l HTML page by the client computer from the server, the 

Still further in accordance with a preferred embodiment of original HTML page containing a view window within 

the present invention the initial sending step also includes 25 which image data is displayed, the view window being 

sending client state information to the server computer. partitioned into sub -regions at least one of which contains a 

Moreover in accordance with a preferred embodiment of multiplicity of pixels, selecting a location within the view 

the present invention the client state information includes window corresponding to one of the sub -regions by the user, 

the size and location of the view window. and receiving a new HTML page by the client computer 

Additionally in accordance with a preferred embodiment 30 from the server computer, in response to the sub-region 

of the present invention the method also includes the step of which was selected. 

associating image portions with each of the sub-regions, and Moreover in accordance with a preferred embodiment of 

wherein the embedded image is that image portion corre- the present invention the selecting step includes positioning 

sponding to that sub-region indicated by the indication. a pointer of a mouse input device on a pixel within the view 

Moreover in accordance with a preferred embodiment of 35 window, and clicking on the mouse input device, 
the present invention some of the image portions are derived Additionally in accordance with a preferred embodiment 
from portions of the digital data. 0 f the present invention the digital data is a tiled multi- 
Further in accordance with a preferred embodiment of the resolution image file, such as a FLASHPIX® image file, 
present invention some of the image portions correspond to Further in accordance with a preferred embodiment of the 
magnified portions of the first image. present invention the new HTML page contains a link to an 

Still farther in accordance with a preferred embodiment of embedded image, 

the present invention some of the image portions correspond Stffl m accordance with a p referred embodiment of 

to the portions of the first image which he within the me n , invention the link t0 ^ embedded image is a 

sub-regions associated with the image portions, magnified to s ^ of commands formmg part of me Intern et imaging 

the size of the view window. Protocol (IIP). 

Moreover in accordance with a preferred embodiment of . , ... , , . ,. , , 

, , . c, ■ j Moreover in accordance with a preferred embodiment of 

thepresentmvention some of the image portions correspond ^ t .^.^ ffie J, rf commlnds formi 

o portions ot the hrst image which lie in regions strictly * f ^ u? 

a convert fCVT) command, 

larger than the sub-regions associated with the image r , v ' 

portions, magnified to the size of the view window. 50 Additionally m accordance with a preferred embodiment 

Further in accordance with a preferred embodiment of the of the present invention the sequence of commands forming 

present invention some of the image portions extend outside P art of the IIP mcludes a re 8 lon ( RGN ) «""mand. 

of the first image. Further in accordance with a preferred embodiment of the 

Additionally in accordance with a preferred embodiment ss P resent invention the sequence of commands forming part of 

of the present invention the creating step is implemented by ^ np mcludes a width (WID) command, 

means of a Java server. Still further in accordance with a preferred embodiment of 

Moreover in accordance with a preferred embodiment of tne present invention the sequence of commands forming 

the present invention the creating step is implemented by P art of IIP includes a height (HEI) command, 

means of a Java servlet. 60 Moreover in accordance with a preferred embodiment of 

Further in accordance with a preferred embodiment of the the present invention the embedded image is built from tiles 

present invention the link to an embedded image is a within a multi-resolution image file, such as a FLASHPIX® 

sequence of commands forming part of the Internet Imaging image file. 

Protocol (IIP). There is also provided in accordance with a preferred 

Still further in accordance with a preferred embodiment of 65 embodiment of the present invention a method for generat- 

the present invention the sequence of commands forming ing dynamic HTML pages on a server computer, to enable 

part of the IIP includes a convert (CVT) command. a user to interactively view a digital image on a client 
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computer within a view window which is partitioned into 
sub-regions at least one of which contains a multiplicity of 
pixels, by interactive selecting of sub-regions by the user, 
including receiving from the client computer an indication 
of which of the sub- regions is selected by the user, creating 5 
an HTML page containing a link to an embedded image 
which corresponds to the indication, and sending the HTML 
page to the client computer. 

Moreover in accordance with a preferred embodiment of 
the present invention the indication is the location of a pixel 1( > 
pointed to by a mouse input device attached to the client 
computer. 

Additionally in accordance with a preferred embodiment 
of the present invention the method also includes the step of 
identifying that sub-region within which the pixel location is 15 
situated. 

Further in accordance with a preferred embodiment of the 
present invention the receiving step also includes receiving 
client state information. ^ 

Still further in accordance with a preferred embodiment of 
the present invention the client state information includes 
the size and location of the view window. 

Moreover in accordance with a preferred embodiment of 
the present invention the method also includes including the 25 
step of associating image portions with each of the sub- 
regions, and wherein the embedded image is that image 
portion corresponding to the sub-region indicated by the 
indication. 

Additionally in accordance with a preferred embodiment 30 
of the present invention the creating step is implemented by 
means of a Java server. 

Moreover in accordance with a preferred embodiment of 
the present invention the creating step is implemented by 
means of a Java servlet. 35 

Further in accordance with a preferred embodiment of the 
present invention the link to an embedded image is a 
sequence of commands forming part of the Internet Imaging 
Protocol (IIP). ^ 

Still further in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
part of the IIP includes a convert (CVT) command. 

Moreover in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 45 
part of the IIP includes a region (RGN) command. 

Additionally in accordance with a preferred embodiment 
of the present invention the sequence of commands forming 
part of the IIP includes a width (WID) command. 

Further in accordance with a preferred embodiment of the 50 
present invention the sequence of commands forming part of 
the IIP includes a height (HEI) command. 

Still further in accordance with a preferred embodiment of 
the present invention the digital image is a tiled multi- S5 
resolution image, such as a FLASHPIX® image. 

Moreover in accordance with a preferred embodiment of 
the present invention the embedded image is built from tiles 
within a multi-resolution image file, such as a FLASHPIX® 
image file. 60 

There is also provided in accordance with a preferred 
embodiment of the present invention an archival system for 
archiving digital data on a server computer, and enabling a 
user, by means of a client computer, to interactively view a 
digital image derived from the digital data, including a first 65 
communication channel for receiving an original HTML 
page by the client computer from the server computer and 
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for subsequently sending a new HTML page by the server 
computer to the client computer, the original HTML page 
containing a view window within which a first image is 
displayed, the view window being partitioned into sub- 
regions at least one of which contains a multiplicity of 
pixels, an input device for enabling the user to select a 
location within the view window corresponding to one of the 
sub -regions, a second communication channel for sending 
by the client computer to the server computer an indication 
of the sub -region selected by the user, and a processor for 
creating by the server computer the new HTML page 
containing a link to an embedded image which corresponds 
to the indication. 

Additionally in accordance with a preferred embodiment 
of the present invention the input device is a keyboard. 

Moreover in accordance with a preferred embodiment of 
the present invention the input device includes a mouse 
input device for positioning a pointer on a pixel within the 
view window, and a mouse key for clicking on the mouse 
input device. 

Additionally in accordance with a preferred embodiment 
of the present invention the indication is the location of the 
pixel pointed to by the mouse input device. 

Further in accordance with a preferred embodiment of the 
present invention the system also includes a coordinate 
processor for identifying that one sub -regions within which 
the pixel location is situated. 

Still further in accordance with a preferred embodiment of 
the present invention the second communication channel is 
also used to send client state information to the server 
computer. 

Moreover in accordance with a preferred embodiment of 
the present invention the client state information includes 
the size and location of the view window. 

Additionally in accordance with a preferred embodiment 
of the present invention the system also includes a list of 
image portions for associating image portions with each of 
the sub-regions, and wherein the embedded image is that 
image portions corresponding to the sub-region indicated by 
the indication. 

Moreover in accordance with a preferred embodiment of 
the present invention some of the image portions are derived 
from portions of the digital data. 

Further in accordance with a preferred embodiment of the 
present invention some of the image portions correspond to 
magnified portions of the first image. 

Still further in accordance with a preferred embodiment of 
the present invention some of the image portions correspond 
to the portions of the first image which lie within the 
sub -regions associated with the image portions, magnified to 
the size of the view window. 

Moreover in accordance with a preferred embodiment of 
the present invention some of the image portions correspond 
to portions of the first image which lie in regions strictly 
larger than the sub -regions associated with the image 
portions, magnified to the size of the view window. 

Further in accordance with a preferred embodiment of the 
present invention some of the image portions extend outside 
of the first image. 

Additionally in accordance with a preferred embodiment 
of the present invention the processor is a Java server. 

Moreover in accordance with a preferred embodiment of 
the present invention the processor is a Java servlet. 

Further in accordance with a preferred embodiment of the 
present invention the link to an embedded image is a 
sequence of commands forming part of the Internet Imaging 
Protocol (IIP). 



07/25/2003, EAST Version: 1,04.0000 



US 6,3: 

9 

Still further in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
part of the IIP includes a convert (CVT) command. 

Moreover in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
part of the IIP includes a region (RGN) command. 

Additionally in accordance with a preferred embodiment 
of the present invention the sequence of commands forming 
part of the IIP includes a width (WID) command. 

Further in accordance with a preferred embodiment of the 
present invention the sequence of commands forming part of 
the IIP includes a height (HEI) command. 

Still further in accordance with a preferred embodiment of 
the present invention the digital data is a tiled multi- 
resolution image file, such as a FLASHPIX® image file. 

Moreover in accordance with a preferred embodiment of 
the present invention the embedded image is built from tiles 
within a multi-resolution file, such as a FLASHPIX® image 
file. 

There is also provided in accordance with a preferred 
embodiment of the present invention a client viewing system 
for interactive viewing of a digital image by a user, the 
viewing being controlled by a client computer, employing 
digital data residing on a server computer, including a 
communication channel for receiving an original HTML 
page by the client computer from the server computer, the 
original HTML page containing a view window within 
which image data is displayed, the view window being 
partitioned into a plurality of sub-regions at least one of 
which contains a multiplicity of pixels, an input device for 
enabling the user to select a location within the view window 
corresponding to one of the sub-regions, and a communi- 
cation channel for receiving a new HTML page by the client 
computer from the server computer, in response to the 
sub-region which was selected. 

Additionally in accordance with a preferred embodiment 
of the present invention the input device is a keyboard. 

Further in accordance with a preferred embodiment of the 
present invention the input device includes a mouse input 
device for positioning a pointer on a pixel within the view 
window, and a mouse key for clicking on the mouse input 
device. 

Still further in accordance with a preferred embodiment of 
the present invention the digital data is a tiled multi- 
resolution image file, such as a FLASHPIX® image file. 

Moreover in accordance with a preferred embodiment of 
the present invention the new HTML page contains a link to 
an embedded image. 

Additionally in accordance with a preferred embodiment 
of the present invention the link to an embedded image is a 
sequence of commands forming part of the Internet Imaging 
Protocol (IIP). 

Further in accordance with a preferred embodiment of the 
present invention the sequence of commands forming part of 
the IIP includes a convert (CVT) command. 

Still further in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
part of the IIP includes a region (RGN) command. 

Moreover in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
part of the IIP includes a width (WID) command. 

Additionally in accordance with a preferred embodiment 
of the present invention the sequence of commands forming 
part of the IIP includes a height (HEI) command. 
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Further in accordance with a preferred embodiment of the 
present invention the embedded image is built from tiles 
within a multi-resolution image file, such as a FLASHPIX® 
image file. 

5 There is also provided in accordance with a preferred 
embodiment of the present invention a server dynamic 
HTML system for generating dynamic HTML pages on a 
server computer, to enable a user to interactively view a 
digital image on a client computer within a view window 

10 which is partitioned into sub-regions at least one of which 
contains a multiplicity of pixels, by interactive selecting of 
sub -regions by the user, including a first communication 
channel for receiving from the client computer an indication 
of which of the sub -regions is selected by the user, a 

15 processor for creating an HTML page containing a link to an 
embedded image which corresponds to the indication, and a 
second communication channel for sending the HTML page 
to the client computer. 
Moreover in accordance with a preferred embodiment of 

20 the present invention the indication is the location of a pixel 
pointed to by a mouse input device attached to the client 
computer. 

Additionally in accordance with a preferred embodiment 
of the present invention the system also includes a coordi- 
25 nate processor for identifying that sub -region within which 
the pixel location is situated. 

Further in accordance with a preferred embodiment of the 
present invention the first communication channel also 
30 receives client state information. 

Still further in accordance with a preferred embodiment of 
the present invention the client state information includes 
the size and location of the view window. 

Moreover in accordance with a preferred embodiment of 
35 the present invention the system also includes a list of image 
portions for associating image portions with each of the 
sub -regions, and wherein the embedded image is that image 
portion corresponding to the sub-region indicated by the 
indication. 

40 Additionally in accordance with a preferred embodiment 
of the present invention the processor is a Java server. 

Moreover in accordance with a preferred embodiment of 
the present invention the processor is a Java servlet. 
Further in accordance with a preferred embodiment of the 
45 present invention the link to an embedded image is a 
sequence of commands forming part of the Internet Imaging 
Protocol (IIP). 
Still further in accordance with a preferred embodiment of 
5Q the present invention the sequence of commands forming 
part of the IIP includes a convert (CVT) command. 

Moreover in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
part of the IIP includes a region (RGN) command. 
S5 Further in accordance with a preferred embodiment of the 
present invention the sequence of commands forming part of 
the IIP includes a width (WID) command. 

Still further in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
60 part of the IIP includes a height (HEI) command. 

Moreover in accordance with a preferred embodiment of 
the present invention the digital image is a tiled multi- 
resolution image, such as a FLASHPIX® image. 

Additionally in accordance with a preferred embodiment 
65 of the present invention the embedded image is built from 
tiles within a multi-resolution image file, such as a FLASH- 
PIX® image file. 
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There is also provided in accordance with a preferred 
embodiment of the present invention a method for archiving 
digital data on a computer and enabling a user to interac- 
tively view a digital image derived from the digital data, 
including receiving from the computer a layout containing a 5 
view window within which an image is displayed, the view 
window being partitioned into sub -regions at least one of 
which contains a multiplicity of pixels, selecting a location 
within the view window corresponding to one of the sub- 
regions by the user, and providing by the computer to the 10 
user a layout containing a reference to an image which 
corresponds to the sub -region selected by the user. 

Moreover in accordance with a preferred embodiment of 
the present invention the selecting step includes positioning 
a pointer of a mouse input device on a pixel within the view 15 
window, and clicking on the mouse input device. 

Additionally in accordance with a preferred embodiment 
of the present invention the method also includes the step of 
associating image portions with each of the sub-regions, and 
wherein the reference to an image is a reference to that 20 
image portion corresponding to the sub -region selected by 
the user. 

Further in accordance with a preferred embodiment of the 
present invention some of the image portions are derived ^ 
from portions of the digital data. 

Still further in accordance with a preferred embodiment of 
the present invention the digital data is a tiled multi- 
resolution image file, such as a FLASHPIX® image file. 

Moreover in accordance with a preferred embodiment of 30 
the present invention the reference to an image is a reference 
to a multi-resolution image, such as a FLASHPIX® image. 

There is also provided in accordance with a preferred 
embodiment of the present invention a system for archiving 
digital data on a computer and enabling a user to interac- 35 
tively view a digital image derived from the digital data, 
including apparatus providing a layout containing a view 
window within which an image is displayed, the view 
window being partitioned into sub-regions at least one of 
which contains a multiplicity of pixels, an input device for 40 
enabling a user to select a location within the view window 
corresponding to one of the sub-regions, and apparatus 
providing a layout containing a reference to an image which 
corresponds to the sub-region selected by the user. 

Moreover in accordance with a preferred embodiment of 45 
the present invention the input device includes a mouse 
input device for positioning a pointer on a pixel within the 
view window, and a mouse key for clicking on the mouse 
input device. 

Additionally in accordance with a preferred embodiment 50 
of the present invention the system also includes a list of 
image portions for associating image portions with each of 
the sub-regions, and wherein the reference to an image is a 
reference to that image portion corresponding to the sub- 
region selected by the user. ss 

Further in accordance with a preferred embodiment of the 
present invention some of the image portions are derived 
from portions of the digital data. 

Still further in accordance with a preferred embodiment of 60 
the present invention the digital data is a tiled multi- 
resolution image file, such as a FLASHPIX® image file. 

Moreover in accordance with a preferred embodiment of 
the present invention the reference to an image is a reference 
to a multi- resolution image, such as a FLASHPIX® image, es 

Tnere is also provided in accordance with a preferred 
embodiment of the present invention a method for archiving 
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digital data on a server computer, and enabling a user, by 
means of a client computer, to interactively view a digital 
image derived firom the digital data, including receiving an 
original HTML page by the client computer firom the server 
computer, the original HTML page containing a view win- 
dow within which a first image is displayed, selecting a 
command by the user, initial sending by the client computer 
to the server computer an indication of the command 
selected by the user, creating by the server computer a new 
HTML page containing a link to an embedded image which 
corresponds to the indication, and further sending the new 
HTML page by the server computer to the client computer. 

Moreover in accordance with a preferred embodiment of 
the present invention the original HTML page contains at 
least one button, and the selecting step includes positioning 
a pointer of a mouse input device on a selected button within 
the original HTML page, and clicking on the button. 

Additionally in accordance with a preferred embodiment 
of the present invention the indication is an index associated 
with the selected button. 

Further in accordance with a preferred embodiment of the 
present invention the first sending step also includes sending 
client state information to the server computer. 

Still further in accordance with a preferred embodiment of 
the present invention the client state information includes 
the size and location of the view window. 

Moreover in accordance with a preferred embodiment of 
the present invention the client state information includes an 
indication of the region within the digital image occupied by 
the first image. 

Additionally in accordance with a preferred embodiment 
of the present invention the client state information includes 
an indication of the region within the digital image initially 
occupied by the first image. 

Further in accordance with a preferred embodiment of the 
present invention the link to an embedded image is a 
sequence of commands forming part of the Internet Imaging 
Protocol (IIP). 

Still further in accordance with a preferred embodiment of 
the present invention the sequence of commands forming 
part of the IIP includes a convert (CVT) command. 

Moreover in accordance with a preferred embodiment of 
the present invention the digital data is a tiled multi- 
resolution image file, such as a FLASHPIX® image file. 

Additionally in accordance with a preferred embodiment 
of the present invention the embedded image is built from 
tiles within a multi-resolution image file, such as a FLASH- 
PIX® image file. 

There is also provided in accordance with a preferred 
embodiment of the present invention a method for interac- 
tive viewing of a digital image by a user, the viewing being 
controlled by a client computer, employing digital data 
residing on a server computer, including receiving an origi- 
nal HTML page by the client computer from the server 
computer, the original HTML page containing a view win- 
dow within which image data is displayed, selecting a 
command by the user, and receiving a new HTML page by 
the client computer, said new HTML page containing a link 
to an embedded image which corresponds to the command. 

Moreover in accordance with a preferred embodiment of 
the present invention the selecting step includes positioning 
a pointer of a mouse input device on a selected button within 
the original HTML page, and clicking on the selected button. 

Additionally in accordance with a preferred embodiment 
of the present invention the digital data is a tiled multi- 
resolution image file, such as a FLASHPIX® image file. 



07/25/2003, EAST Version: 1.04.0000 



US 6,356,283 Bl 

13 14 

Further in accordance with a preferred embodiment of the Still further in accordance with a preferred embodiment of 

present invention the link to an embedded image is a the present invention the client state information includes 

sequence of commands forming part of the Internet Imaging the size and location of the view window. 
Protocol (IIP). 

Moreover in accordance with a preferred embodiment of 

Still further in accordance with a preferred embodiment of 5 the present invention the client state, information includes an 

the present invention the sequence of commands forming indication of the region within the digital image occupied by 

part of the IIP includes a convert (CVT) command. me g rst j^gg 

Moreover in accordance with a preferred embodiment of Additionally in accordance with a preferred embodiment 

the present invention the embedded image is built from tiles of the present invcntion mc clicnt state information includes 

within a multi-resolution image file, such as a FLASHPIX® 10 an indication of the region within the digital image initially 

file * occupied by the first image. 

There is also provided in accordance with a preferred Moreover in accordance with a preferred embodiment of 

embodiment of the present invention a method for generat- ^ m iavention the ^ t0 m embe dded image is a 

ing dynamic HTML pages on a server computer, to enable se ™ ence of comman ds forming part of the Internet Imaging 

a user to interactively view a digital image on a client 15 p rotoco i mp} 

computer, by interactive selection of a command by the user, . ,, v . ' . . ... c A , «. 

c *u i- . * • j- ** Additionally m accordance with a preferred embodiment 

mcluding receiving from the client computer an indication £ . /. 4l _ r - , f 

f , . z j . 1 * j l it. *• „ of the present invention the sequence or commands iormmg 

of which command is selected by the user, creating an / TTn . _ , ^ , /rnm , b 

rrrm || . . . , . ' . aa-a 1 ~ „ u.v.u part of the IIP mcludes a convert (CVT) command. 

HTML page containing a link to an embedded image which „ . . , . , \ / * ^> r. 

corresponds to the indication, and sending the HTML page 20 Further ia accordance with a preferred embodiment of the 

to the client computer. present invention the digital data is a tiled multi-resolution 

Moreover in accordance with a preferred embodiment of image file, such as a FLASHPIX® image file, 

the present invention the indication is an index associated Still further in accordance with a preferred embodiment of 

with the selected command tne present invention the embedded image is built from tiles 

Additionally in accordance with a preferred embodiment 25 within a mnlti-resolution image file, such as a FLASHPIX® 

of the present invention the receiving step also includes image file. 

receiving client state information. There & ako provided in accordance with a preferred 

Further in accordance with a preferred embodiment of the embodiment of the present invention a client viewing system 

present invention the link to an embedded image is a *>r interactive viewing of a digital image by a user, the 

sequence of commands forming part of the Internet Imaging 30 viewing being controlled by a client computer, employing 

Protocol (11?) digital data residing on a server computer, including a 

Still further in accordance with a preferred embodiment of communication channel for receiving an original HTML 

the present invention the sequence of commands forming P a S e b y com P llte i r . fr « n server c ° m P u,er : ,' he 

part of the IIP includes a convert (CVT) command. »°fj»? H ™ L ( W contammg a view window wi hin 
r w . , r j L-r 4*35 which image data is displayed, an input device for enabling 

Moreover in accordance with a preferred embodunent of & ^ to ^ & and & communication channel 

the present invention the digital image is a tiled mult- for receiving a new HTML page by the client computer from 

resolution image, such as a FLASHPIX® image. ^ ^ ^ ^ ^ HTlv1Lpage containiDg a ^ 

Additionally in accordance with a preferred embodiment tQ aQ embedded which corresponds to the command, 

of the present invention the embedded image is built from ^ ^ re e t0 the command which was selected, 

tiles within a multi -resolution image file, such as a FLASH- . , . , - - , - 

p f8> • fil Moreover m accordance with a preferred embodiment 01 

image e. the present invention the input device is a keyboard. 

There is also provided in accordance with a preferred „ . , ^ * j u j* 

embodiment of the present invention an archival system for Additionally in accordance with a preferred embodmien 

... . , , ™m;™ * of the present invention the input device is a mouse input 

archiving digital data on a server computer, and enabling a 45 . v r r 

user, by means of a client computer, to interactively view a device. 

digital image derived from the digital data, including a first Further in accordance with a preferred embodiment of the 

communication channel for receiving an original HTML present invention the digital data is a tiled multi-resolution 

page by the client computer from the server computer and image file, such as a FLASHPIX® image file, 

for subsequently sending a new HTML page by the server 50 Still further in accordance with a preferred embodiment of 

computer to the client computer, the original HTML page the present invention the link to an embedded image is a 

containing a view window within which a first image is sequence of commands forming part of the Internet Imaging 

displayed, an input device for enabling a user to select a Protocol (IIP). 

command by the user, a second communication channel for Moreover in accordance with a preferred embodiment of 

sending by the client computer to the server computer an 55 the present invention the sequence of commands forming 

indication of the command selected by the user, and a part of the IIP includes a convert (CVT) command, 

processor for creating by the server computer the new Additionally in accordance with a preferred embodiment 

HTML page with a link to an embedded image which 0 f the present invention the embedded image is built from 

corresponds to the indication. tiles within a multi-resolution image file, such as a FLASH- 

Moreover in accordance with a preferred embodiment of 60 PIX® image file, 

the present invention the input device is a keyboard. There is also provided in accordance with a preferred 

Additionally in accordance with a preferred embodiment embodiment of the present invention a server dynamic 

of the present invention the input device is a mouse input HTML system for generating dynamic HTML pages on a 

device. server computer, to enable a user to interactively view a 

Further in accordance with a preferred embodiment of the 65 digital image on a client computer, by interactive selecting 

present invention the second communication channel also of commands by the user from among a plurality of 

sends client state information to the server computer. commands, including a first communication channel for 
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receiving from the client computer an indication of which of BRIEF DESCRIPTION OF THE DRAWINGS 

the commands is selected by the user, a processor for . . ■« . r * 

creating an HTML page containing a link to an embedded FIG ' 1 18 a simplified diagram illustrating an Internet 

image which corresponds to the indication, and a second communication configuration between a client and a server; 

communication channel for sending the HTML page to the 5 FIG. 2 is a diagram illustrating a partition of an image 

client computer. region into sub-regions for the purpose of zooming; 

Moreover in accordance with a preferred embodiment of FIG. 3 is a simplified flow chart indicating the operation 

the present invention the indication is an index associated 0 f a preferred embodiment of the present invention in 

with the selected command. response to a single user command; 

Additionally in accordance with a preferred embodiment 10 FIG 4 fe a simpiified fl owc hart of the operation of the 

of the present invention the first communication channel embodiment of FIG 3* 

also receives client state information. p[G g .. a ^ flow ^ ^ ^ ^ 

FurtheriQaccordancewithapreferredembodimentofthe of a [cm(J embodiment of ^ preseDt invention ^ 

present invention the hnk to an embedded mage is a ^ to a ^ ^ mmau]j % 

sequence of commands forming part 01 the Internet Imaging 15 , „ t ^ , . . „ tt _ 

Protocol (IIP) 6 is a simphfied flowchart of the operation or the 

Still further in accordance with a preferred embodiment of embodiment of FIG. 5, and 

the present invention the sequence of commands forming FIG 7 is a diagram illustrating a partition of an image into 

part of the IIP includes a convert (CVT) command. sub-regions for the purpose of panning m accordance with a 

Moreover in accordance with a preferred embodiment of 20 Purred embodiment of the present invention, 

the present invention the digital image is a tiled multi- LIST OF APPENDICES 
resolution image, such as a FLASHPIX® image. 

Further in accordance with a preferred embodiment of the Appendix A is a listing of four HTML pages, the first 

present invention the embedded image is built from tiles corresponding to an initial image view, the second corre- 

within a multi-resolution image file, such as a FLASHPIX® ^ sponding to a zoomed-in view, the third corresponding to a 

image file. view that can be panned, and the fourth being a template. 

There is also provided in accordance with a preferred Appendix B is a listing of sample server-side software, in 

embodiment of the present invention a method for archiving the form of a Java server, for supporting the HTML-driven 

digital data on a computer and enabling a user to interac- client, according to a preferred embodiment of the present 

tively view a digital image derived from the digital data, 30 invention. 

including receiving from the computer a layout containing a npsPRTPTTON OF PRFFERRED 

view window within which an image is displayed, selecting Dh IA1LLD DbSLKIF 1UIN \Vb PKb^bKKbU 

a command by the user, and providing by the computer to EMBODIMENTS 

the user a layout containing a reference to an image which The present invention concerns a client/server architec- 

corresponds to the command selected by the user. 35 ture for interactive viewing of image data. Specifically, it 

Moreover in accordance with a preferred embodiment of deals with large images, where the full resolution image 

the present invention the selecting step includes positioning cannot be downloaded over the Internet quickly, and also 

a pointer of a mouse input device on a selected button within may not fit within a viewing window on a computer monitor, 

the layout, and clicking on the button. Instead the user can view only a portion of the image at any 

Additionally in accordance with a preferred embodiment given instant, and inspects the image by interactively 

of the present invention the digital data is a tiled multi- manipulating it so that various portions, possibly at various 

resolution image file, such as a FLASHPIX® image file. resolutions, are displayed in the view window in response to 

Further in accordance with a preferred embodiment of the user commands, 

present invention the reference to an image is a reference to 45 The basic units of interactivity when viewing large 

a multi-resolution image, such as a FLASHPIX® image. images are pan and zoom. Panning involves sliding the 

There is also provided in accordance with a preferred portion of the image being viewed left, right, up and down, 

embodiment of the present invention a system for archiving Zooming involves zooming in on parts of the image 

digital data on a computer and enabling a user to interac- (magnification) to see finer detail, and zooming out 

lively view a digital image derived from the digital data, 50 (reduction) to see a larger portion of the image, with less 

including apparatus providing an original layout containing detail, in the same view window. 

a view window within which an image is displayed, an input When viewing flat 2-D images, the portion of the image 

device for enabling the user to select a command, and being viewed is based directly upon the stored image data, 

apparatus providing a new layout containing a reference to When viewing panoramas (360 degree vistas), which are 

an image which corresponds to the command selected by the S5 mapped onto geometrical surfaces such as cylinders or 

user. spheres, the portion of the image being viewed is trans- 

Moreover in accordance with a preferred embodiment of formed from stored image data, corresponding to the appro - 

the present invention the input device includes a mouse priate projection that maps the surface onto the current view 

input device for positioning a pointer on a button within the plane along the lines of sight of the viewer. Each view 

original layout, and a mouse key for clicking on the mouse 60 requires a distinct transformations for its view plane, 

input device. Client/server systems operate by archiving the image data 

Additionally in accordance with a preferred embodiment on a server computer, and enabling client computers to 

of the present invention the digital data is a tiled multi- connect via the Internet and access the image data. In this 

resolution image file, such as a FLASHPIX® image file. way, the image data is made available to a broad audience 

Further in accordance with a preferred embodiment of the 65 of users, and it is not necessary for the client computers to 

present invention the reference to an image is a reference to store a local copy of the image data. This is especially 

a multi-resolution image, such as a FLASHPIX® image. advantageous in light of the large size of the image data files, 
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and the limited memory resources on the client computer. multi-resolution tiled format. Specifically, a high resolution 
Client/server systems make it possible for users to view an image is pre-filtered into a pyramid of lower resolution 
unlimited number of images. images, all of which are stored with the full resolution image 
Aprimary drawback with client/server systems is network within the FLASHPIX® file. In addition, all of the indi- 
gency, which causes delays in data access via the Internet. 5 vidual resolution images are partitioned into tiles, which are 
Waiting for large amounts of data to download is annoying blocks of contiguous image data. Currently the FLASH- 
to users, and thus interactive application designers prefer to FIX® format employs tiles of 64x64 pixels. The tiles can be 
operate by transmitting just enough data for rendering the individually compressed. A reference for FLASHPIX® is 
image portion to be displayed. However, for both flat 2-D the document "FlashPix Format Specification/' ©1996, 
and panoramic images, in order to render the portion of the 10 1997, Eastman Kodak Company. 

image to be displayed, the client computer has to have In order to construct a specific image portion at a specific 

received a corresponding portion of the archived image data resolution, it is necessary to assemble ("stitch") together all 

from the server computer. This in turn requires that new data of the tiles from the specific resolution that are part of the 

be transmitted in response to each interactive user specific portion. For example, generating a 256x256 image 

command, which leads to a non -smooth interactive user 15 portion from a given resolution may involve assembling a 

experience, whereby the navigation appears to proceed in 4x4 array of tiles. An application may be designed so as to 

"spurts/' send the tiles directly to the client, unassembled, in which 

For multimedia such as flat 2-D images and panoramas, case the client has to assemble them by means of client 

whereby the user typically accesses the same data repeatedly software in the form of a plug-in, Active-X control or Java 

while navigating, caching can alleviate the network latency 20 applet. 

problem to a limited extent. Ideally the user experience Alternatively, an application may be designed to have the 

should be independent of whether the images being viewed server do the assembly, and transmit the assembled image 

are stored remotely on servers or locally on the user's disk. portion to the client. In this case, the browser software 22 

Referring to FIG. 1, there is depicted a simplified diagram may be able to display the image portion directly, without 

of a client/server system. As is known in the prior art, a 25 the need to use client software. 

server computer 10 contains HTML pages 12, each of which Complementing FLASHPIX®, there exists the Internet 

contains display layout information, URL links for embed- Imaging Protocol (IIP), which is a set of commands for 

ding images, and instructions to launch server applications requesting data from a FLASHPIX® image file. When the 

such as Java applications, referred to as "Java servers," and application operates by sending unassembled tiles from the 

Java applets, referred to as "Java servlets " The embedded 30 server 10 to the client 20, the client issues a tile (TIL) 

images are derived from image files 14 residing on the command, specifying a single tile or multiple tiles to be 

server, and the server applications are stored as server transmitted. In turn, the client receives each tile individually, 

software 16 on the server. typically in compressed format. 

In accordance with a preferred embodiment of the present 35 Alternatively, when the application operates by assem- 

invention, the HTML pages 12 contain viewing windows bling the tiles into an image portion on the server, the client 

which are partitioned into a plurality of sub-regions, and the issues a convert (CVT) command, specifying a rectangular 

server software is used to dynamically generate HTML region of the image along with a display resolution. The 

pages in response to user selection of sub-regions. server then functions to identify which resolution in the 

At remote sites several client computers 20 are connected ^ FLASHPIX® image pyramid is appropriate for the specified 

to the server 10. Each client computer contains browser region and display resolution, and which tiles are required, 

software 22, such as Netscape Navigator or Microsoft Inter- It extracts those tiles from the image file, assembles them 

net Explorer. The browser software 22 communicates with together into a rectangular image portion, and typically 

the server computer 10, and controls transmission of data 26, compresses the resulting image. The final result is transmit- 

which includes HTML, applet, image and other data, from 45 ted to the client for display. 

the server to the client. The data 26 is either used directly by Server cache 38 can be used to save assembled image 

the browser to display the HTML page, or, if necessary or portions for re-use, in case other clients request the same 

preferred, the optional client software 24 is invoked. image portion, or in case the same client navigates back to 

The vehicle for connecting the clients to the server is the the same image portion. Having image portions available 

Internet, with its multitude of connections 30. Requests for 50 saves the assembly processing, yielding faster response 

data along such a connection should comply with an Internet time. 

protocol, such as HTTP's GET command, or those of other Similarly a client cache 40 can also be used to store image 

protocols such as FTP or SMTP. portions for future re-use. On account of the limited memory 

A user 32, who operates the client computer 20, interac- available for caching, both servers and clients have to 

tively controls the image portion displayed within the 55 implement smart caching algorithms when their caches are 

HTML page by means of an input device such as a mouse full, to decide what data to keep and what data to discard, 

and keyboard 34. The HTML page with the image portion Referring now to FIG. 2, there is shown a viewing 

embedded therein is displayed on a display device 36. The window 42, which is typically part of an HTML page layout, 

user 32 views the display screen and in turn adjusts the The image portion being viewed by the user is displayed in 
image portion being viewed by issuing commands via the eo this window. In a preferred embodiment of the present 

mouse and keyboard 34. invention, the viewing window 42 is partitioned into imagi- 

Additionally, the server can use its local cache 38 to store nary sub-regions 44. These sub-regions are imaginary in the 

image data that can be repeatedly requested. This is espe- sense that they are not visible to the user, but are used for 

cially efficient if the data portions transmitted from server to computational purposes. 

client require special assembly from the data in the image 65 FIG. 2 illustrates an example of zoo min g in. The user 

files 14. In a preferred embodiment of the present invention, positions a mouse pointer 46 at a position within the view 

the image files 14 are FLASHPIX® files. FLASHPIX® is a window, and clicks on the mouse. This issues a request to 
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zoom in on the portion of the image where the mouse pointer The client computer first receives the HTML page 56, 

is located. In a preferred embodiment, the present invention without having the data for rendering the embedded image, 

operates by identifying a specific image portion, associated In a preferred embodiment of the present invention, the 

with the sub-region containing the mouse pointer 46, to be HTML page 56 identifies the image portion to be embedded 

magnified. 5 as a URL with a sequence of IIP commands. The IIP 

FIG. 2 illustrates a partition containing five sub -regions command sequence contains a reference to the FLASH- 

44, indicated by the solid lines in FIG. 2. The user selects pjx® image file, a specification of the region of the FLASH- 

one of these sub-regions by clicking at a location in the view P1X ® i mage to be displayed, information about the pixel 

window. In turn, each of these sub-regions is used to trigger dimensions of the view window, and a CVT command, 

the server to embed an appropriate image portion m the 1Q encounters the , ip command ^ m6 

server s response. Specifically, in a preferred embodiment oi , TT _> . * ■ j * *„ . ™ 

thepresentinventioD, each of these sub-regions isassociated sends an IIP for data 58 to the saver. The 

with a rectangular region 48, indicated for sub-region 1 by serv i T parses * e request accesses the necessary FLASH- 

the dotted lines in FIG. 2. When the user clicks within a PIX ® ima S e ties, assembles them into a rectangular image 

particular sub-region 44, the image portion to be used for the P ortion 60 > ™ d sends & e new back t0 ^ clie nt. In 

response is the region 48 associated with that selected 15 turn, the client then displays the HTML page with the new 

sub-region 44. image portion embedded within it. 

Shown in FIG. 2 are two examples of response regions 48. Appendix A contains examples of three HTML pages, 

The first example is the region marked by the dotted lines. corresponding to an initial view of an image and two 

It contains sub-region 1, but is itself contained with the view successive zoom-ins. Appendix B contains a listing of the 

window. The response image portion is magnified to fit the 20 software which was used to generate these pages, 

size of the full view window, giving the effect of a zoom-in. It ^ apparent to those skilled in the art that the image 

The advantage of choosing response regions 48 that are portion being displayed can also be viewed without the 

strictly larger than the sub-regions 44, is that when the user HTML page, as a stand alone image, 

clicks on the boundary ;0 f z l sub-region, the location cheked Ref mQ illustrated a simplified 

upon is strictly within the image portion displayed m 25 a . . * c j ^j- * * *u * • 

^ i- M r *i- * flowchart of a preferred embodiment of the present inven- 

response, making it easy for the user to relate the response " „7f £ V tt™Jt *u 

image to the previous image. However, it is apparent that bon - Wh ™ browst * fi ,f jesses an HTML page on the 

oneanild instead choose the response regions to coincide server > the P a 8 e 15 sent to the <* ent w * h an > Gltial lavout - ™° 

with the sub-regions, or in almost any arbitrary way. ™ ix ™ 1 HTML P a S e can be either staUc or dynamic. At step 

The second example of a response region in FIG. 2 is the 30 70 the curreDt HTML page is displayed with an image 

region surrounded by the dashed lines. It is the same size as P ortio11 embedded therewithin. At step 72 the user viewing 

the view window, but extends rightward and downward the page clicks on a location within the view window that 

outside the current image data being viewed. Display of this contains the embedded image portion. The browser extracts 

image portion gives the effect of an upward leftward motion. the mouse pointer coordinates where the user clicked at step 

Internet browsers provide a mechanism, referred to as 35 74, and sends them to the server at step 76, 

image maps, for carrying out this process. Image maps At step 78 the server receives the mouse pointer 

enable a browser to extract the coordinates of the location of coordinates, and at step 80 the server calculates which 

the mouse pointer when the user clicks on the mouse, and sub -region contains these coordinates. It then identifies the 

send these coordinates back to the server. The server in turn image portion to be used for the response, based on the 

receives these coordinates and calculates that sub-region 40 sub-region calculated. At step 82 the server dynamically 

within which they are situated. FIG. 2 illustrates a user creates a new HTML page with a link to indicate the 

clicking within sub-region 1. response image portion. In a preferred embodiment of the 

In order to calculate the sub-region within which the present invention, the link is an IIP command sequence, 

mouse coordinates are located, the server also needs to know Examples of such an HTML page are provided in Appendix 

the size and location of the view window; i.e. client state 45 A> and Appendix B contains a listing of the software which 

information. This client state information can also be sent was used to generate them. At step 84 the server sends the 

from the client to the server, together with the mouse newly created HTML page back to the client, 

coordinates. Alternatively, the server can store this informa- At step 86 the client receives the new HTML page, and at 

ti on in its own memory. step 88 the browser processes the page. At step 90 the 

FIG. 3 illustrates a simplified flow chart for one step in a 50 browser recognizes that the HTML page contains a link to 

preferred embodiment of the present invention. After an an embedded image portion. At step 92 the client checks 

initial request is made, an HTML page 50 is displayed on a whether that embedded image portion is already resident in 

client computer 20. The HTML page contains within it a its local cache. If so, then the page can be displayed at once 

view window, such as that illustrated in FIG. 2 and described at step 94, with the embedded image rendered. Otherwise, at 

hereinabove, within which an embedded image portion is 55 step 96 the client sends the request for the image portion 

displayed. Using a mouse or keyboard 34 for positioning, back to the server. Internet browsers support caching, so it 

the user clicks on the mouse at a position within the view is not necessary to use special client software for this, 

window. HTML identifies the image portion being viewed as At step 98 the server processes the request for the image 

an image map, and the client sends the mouse pointer portion. In a preferred embodiment of the present invention, 

coordinates 52 to the server computer 10. The server com- 60 this entails parsing the IIP command sequence, to translate 

puter 10 calculates the sub -region within which the mouse the IIP syntax into specific instructions. At step 100 the 

coordinates are situated, and dynamically creates a new server checks whether the requested image portion is already 

HTML page 54, with a link to an embedded image, consti- resident in its local cache. If so, it immediately sends the 

tuting the response to the user mouse click. Examples of cached image data to the client, at step 102, and the client 

such an HTML page appear in Appendix A, and a listing of 65 receives the data at step 104. Otherwise, at step 106 the 

the software system which generated them appears in server produces the requested image data. In a preferred 

Appendix B. embodiment of the present invention, this entails accessing 
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the appropriate tiles from the specified FLASHPIX® image to the server and, upon receiving the JPEG image data, 

file, and assembling them together. At step 108 the server display the JPEG image with a link, so that when a user 

sends the computed image data to the client. clicks on the displayed image, the browser dispatches an 

The client receives the image data at step 104 and displays HTTP request to the server for the HTML page hello.html. 

the HTML page with the embedded image rendered at step 5 The URL within an HTML instruction can be any data 

94. At this point, the step of going from one displayed mat mc server should understand. For example, an HTML 

HTML page to another, in response to an interactive user instruction 

request, is complete, and the step can be repeated. <AHREF='http://123.456.789.01:8000/photo.fpx,300, 

The present invention also teaches operation of interactive ..^^^^'f^f^^ 

user commands without use of image maps as is described 10 ^!°J^^ a U ? L .^f * IP , ad f rcSS 

hereinbelow 123.456.789.01 and port 8000 with the text string 

„ r . , m , . , .„ "photo.fpx, 300, 300." As long as the server knows how to 

Reference is now made to FIG. 5 which nlustrates a m t ^ ^ k can pf0cess thc HTTp requcst 

simplified flow chart for one step in a preferred embodiment Iq & fcrrcd embodiment, the present invention operates 

of the present invention. FIG. 5 is identical with FIG. 3 with 15 mstructions of me form 

the exception of the element indicated by numeral 110. <A HREF=' <%NEXT_URL%>' xIMAGE SRC= 

Whereas in FIG. 3 mouse pointer coordinates are transmit- *<%IMAGE%>' 

ted from a client to a server, in FIG. 5 a command is ISMAPx/A> 

transmitted. or of the form 

Reference is also made to FIG. 6 which illustrates a 20 <A HREF=* <%INTEXT__URL%>? COMMAND 'xIMAGE 

simplified flowchart of a preferred embodiment of the SRC« , <%IMAGE%> , x/A> 

present invention. FIG. 6 is identical with FIG. 4, with the The server replaces the field %NEXT_URL% with data for 

exception of the steps indicated by numerals 112, 114, 116, the appropriate URL and it replaces the field %IMAGE% 

118 and 120. At step 112 a user clicks on one of several with an IIP request for an image, or with a GIF image, as 

buttons, each corresponding to a specific interactive com- 25 applicable. These fields are dynamically updated within an 

mand. Examples of such commands are (1) centered zoom- HTML page as the user interacts with the image. The 

in, (2) centered zoom-out, (3) pan in one of several COMMAND refers to one of several interactive user 

directions, (4) reset to initial image view and (5) print. At commands, such as ZOOM.JN, ZOOM_OUT, PAN and 

step 114 the browser identifies the area where the user RESET. 

clicked, thereby identifying the button and the desired 30 When using image maps, the browser automatically 

associated user command. At step 116 the client sends the appends a string *?x,y' to the HTTP request, where x and y 

command data to the server in the form of an HTTP request. are me mouse coordinates. The ? symbol serves to delineate 

At step 118 the server receives the user command data the image map parameters from the rest of the HTTP 

embedded within the HTTP request, and extracts it. At step request. When using commands, rather than image maps, a 

120 the server processes the user command so as to deter- 35 preferred embodiment of the present invention appends a 

mine the appropriate image data to be displayed in response string '7COMMAND' to the HTTP request. The server 

to the command. knows whether the data following the ? symbol is image 

Information such as mouse pointer coordinates or a map or command data, since the former has two data tokens 

selected user command is preferably sent from a client to a and the latter has only one data token, 

server by means of an HTTP request. The HTML language 40 In a preferred embodiment of the present invention, the 

offers a mechanism to link an HTTP request with an object. %IMAGE% field is a GIF button image when used in 

Specifically, an HTML instruction conjunction with commands, and the displayed JPEG image 

<AHREF«* hello. html' >Hello </A> when used in conjunction with image maps. That is, in a 

links a URL for an HTML page hello.html with text reading preferred embodiment, the browser displays the JPEG image 

"Hello/* A browser will display text reading "Hello" with a 45 within a display window, underneath of which are several 

link, so that when a user clicks on the text, the browser command buttons. When clicking on the JPEG image, the 

dispatches an HTTP request to the server for the HTML page linked HTTP URL contains image map data, and when 

hello.html. clicking on the command buttons, the linked HTTP URL 

Similarly, an HTML instruction contains command data. It is apparent to one skilled in the 

<A HREF=* hello. html' xIMAGE SRC= 'photo .gifx/A> 50 art that many variations of linking display objects with 

links a URLfor an HTMLpage hello.html with a GIF image HTTP URLs are possible. 

photo.gif. A browser will request the photo.gif image data This mechanism is a key feature of the present invention, 

from the server by means of an HTTP request and, upon It enables a server to provide response image data, in 

receiving the data, display the photo.gif image with a link, response to a user clicking within an image being displayed 

so that when a user clicks on the displayed image, the 55 or clicking on a command button, entirely by means of 

browser dispatches an HTTP request to the server for the HTML pages and without the use of client software other 

HTMLpage hello.html. than the Internet browser itself. In particular, a user con- 

The GIF image in this example can be replaced with a nected to a web site employing server software operative in 

JPEG image, or even with an IIP request for a JPEG image. accordance with the present invention can automatically 

For example, an HTML instruction 60 interact with images on the site without the need to down- 

<AHREF=' hello. html' xIMAGE load client plug-in software or a client Java applet. 

SRCB'fif^photo.fpx&obj^iipjl.O&wid^SOO&heia In a preferred embodiment of the present invention, 

300&cvt=sjpeg J ></A> panning is carried out by means of two HTML pages. The 

links a URL for an HTML page hello.html with a JPEG first page is in zoom mode, and contains a pan command 

image that originates from an IIP request for a 300x300 pixel 65 button, whereby the user can select to be in pan mode. The 

image from photo. fpx in the JPEG format. Again, a browser server responds by sending a second HTML page which is 

will dispatch the above IIP request within an HTTP request in pan mode, whereby the image is partitioned into nine 
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imaginary regions, corresponding to division of the width 
and height into equal thirds, as illustrated in FIG. 7. The 
names "zoom mode" and "pan mode" correspond to the 
functionality provided when clicking somewhere within the 
displayed image. In zoom mode, clicking within the image 
itself effects a zoom-in, whereas in pan mode clicking within 
the image itself near the boundary of the image effects a 
directional pan, preferably in one of eight directions (N, NE, 
E, SE, S, SW, W, NW). 

Referring to FIG. 7, clicking somewhere within the 
middle left third of the image initiates a pan W command, 
resulting in translation, or pulling, of the image leftward by 
a distance in pixels equal to half of the display width. 
Clicking somewhere within the middle bottom third initiates 
a pan S command, resulting in translation of the image 
downward by a distance in pixels equal to half of the display 
height. Clicking somewhere within the middle of the bottom 
left third initiates a pan SW command, resulting in transla- 
tion of the image leftward by a distance in pixels equal to 
half of the display width, and also downward by a distance 
in pixels equal to half of the display height. Clicking 
somewhere within any of the other regions not in the very 
middle of the image has a similar pan effect. Clicking in the 
middle region has an effect of zoom -in. 

It is apparent to one skilled in the art that the panning 
distance is not required to be equal to half of the display 
width for horizontal panning or half of the display height for 
vertical panning. Rather, it can be arbitrarily set. 

Illustrated in FIG. 7 is a current image 122 being dis- 
played. The image is partitioned into the nine regions 
described hereinabove. A user clicks at location 124 in the 
region labeled NW, in order to pan the image in the 
northwest direction. The result of the pan is to display a new 
image portion 126, extending from the center of image 122 
rightward and downward. Note the inverted correspondence, 
whereby an upward pan corresponds to display of an image 
portion below the currently displayed portion, and that a 
leftward pan corresponds to display of an image portion to 
the right of the currently displayed portion. This is because 
the view window remains fixed when the image is translated, 
or pulled. 

Current HTML-driven client applications, such as New 
Mexico Software's IMAGE ASSETS server, customize each 
response to the exact user navigation command. For 
example, when zooming in, they respond with a magnified 
image portion which is exactly centered at the location of the 
mouse pointer. As a result, there is significantly less re-use 
of the same image portions, since the user rarely navigates 
back to exactly the same configuration, and the advantage 
offered by caching is almost entirely eliminated. In turn, the 
server must cany out the processing of each image portion, 
as in step 106 of FIGS. 4 and 6, which drains the server and 
slows down its response time. 

A unique feature of the present invention, that makes it 
practical, is the quantization of the user navigation 
responses. Thus it will be appreciated that the present 
invention is enabling for technologies which desire to avoid 
using client software other than the browser and rely instead 
on dynamic HTML. 

Appendix A lists source files for three dynamically cre- 
ated HTMLpages, and a fourth template HTML page. Afirst 
HTML page contains an initial view of an image photo .fpx. 
The image is obtained by means of an IIP request 
fif=photo.rpx&obj=iip,1.0&wid«300&hei=300&rgn«0.0,0 

.0,1.0,1.0&cvt=jpeg 
Specifically, this IIP request is for data from a FlashPix 
image file photo .fpx using version 1.0 of the IIP protocol. 
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The desired image data corresponds to a 300x300 pixel 
resolution image of the entire region of the FlashPix image, 
in the JPEG format. Note the use of port 8087 with the IIP 
request. Port 8087 is the server port that handles IIP 
5 requests. 

When the user clicks on this image, an HTTP request is 
dispatched to IP address 123.456.789.01 and port 8081. Port 
8081 is the server port that handles incoming data. The data 
sent is a string 

l,photo.fpx,0.0,0.0,1.0,1.0,300,300,0.0,0.0,1.0,1.0,1.0 
The server knows to interpret this string as follows: The first 
data item, 1, is an HTML page number. The second data 
item, photo. fpx, is the name of a FlashPix image file. The 
third data item, 0.0,0.0,1.0,1.0 is the current region of the 
FlashPix image being displayed. Regions are specified as 

15 relative coordinates x ls y l9 x 2 , y 2 where (x l5 yj are the 
coordinates of the lower left corner of the region, and (Xj, 
Y 2 ) are the coordinates of the upper right corner of the 
region. The coordinates are based on a relative scale from 0 
to 1, where 1 corresponds to the full width or height. The 

20 fourth data item, 300,300 are the dimensions of the display 
window, and the fifth data item, 0.0 3 0.0,1 .0,1.0 is the region 
displayed initially. This initial region is used whenever the 
user issues a reset command, as indicated in the software 
fisting in Appendix B. 

25 The image displayed is designated as an image map 
(ISMAP). When a user clicks somewhere within the dis- 
played image, the browser appends a ?x,y to the URL within 
the HTTP request. Thus the actual URL sent from the client 
to the server in response to a user click within the image is 
l,photo.fpx,0.0,0.0,1.0,1.0 7 300,300,0.0 ) 0.0,1.0,1.0,1.0?x,y 
containing a sixth data item, ?x,y, where (x, y) are the mouse 
pointer coordinates. The server knows how to interpret this 
and extract the x, y coordinates, in order to update the region 
for the image to be displayed in response to the user click. 
A second HTML page corresponds to the page in response 

35 to a user having clicked somewhere within the middle region 
of the displayed image photo. fpx. This triggers a centered 
zoom-in. This is indicated in the second HTML page by the 
region 

rgn-0.25,0.25,0.5,0.5 

40 within the IIP request. It may be observed that the IIP syntax 
defines a region in terms of relative parameters x,y,w,h 
where (x, y) are the coordinates of the lower left corner of 
the region, w is the region width and h is the region height. 
Thus 0.25,0.25,0.5,0.5 designates the middle region, extend- 

45 ing from lower left coordinates (0.25, 0.25) to upper right 
coordinates (0.75, 0.75). Displaying this middle region as a 
300x300 pixel image, gives the effect of the desired zoom- 
in. 

A third HTML page corresponds to a pan mode user 
so interface with buttons underneath the displayed image. This 
page is numbered 2, in order to distinguish it from the zoom 
mode page numbered 1. There are buttons for zoom-in, 
zoom-out, pan, reset, print and info. The zoom-out button, 
for example, is displayed by means of a GIF image 
55 zoomout.gif, located in a directory named images. Prefer- 
ably zoomout.gif is a small image of a magnifying glass with 
a + sign in the middle. When a user clicks on this button, an 
HTTP request is dispatched to server port 8081 with the data 
string 

60 l,photo.fpx,0.0,0.0,l. 0,1.0,300,300,0. 0,0. 0,1.0, 1.0, 
1.0?ZOOM_OUT 
The server knows how to interpret this and extract the 

ZOOM OUT command, so that it can modify the region of 

the image to be displayed in response to the user click. 

6S The displayed image is partitioned according to a map 
named "pan." The data in Appendix A corresponds to the 
partition illustrated in FIG. 7 described hereinabove. 
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A fourth HTML page is a template page, with fields that 
are set by the server when it processes a client request It will 
be observed that the template contains fields <%NEXT_ 
URL%>, <%WIDTH%>, <%HEIGHT%>, <%IMAGE%>, 
<%URL%>, <%FILE%>and <%STATE%>. The NEXT_ 
URL tag contains the string of data to be included in an 
HTTP request, with the exception of the ? symbol and the 
data appended thereafter. The NEXT_URL tag can be 
sub -divided into three tags URL, FILE and STATE, where 
URL contains the IP address and port data, FILE contains the 
FlashPix image file name and STATE contains the region 
and dimension data. The WIDTH and HEIGHT tags contain 
the display dimensions. The IMAGE tag contains the HP 
request for the displayed image portion. 

The server dynamically updates the appropriate data for 
each of the above tags, in response to an incoming HTTP 
request, and uses the tags to create an updated HTML page. 

Appendix B is a listing of a Java servlet which can be used 
to generate dynamic HTML pages, like those in Appendix A. 
The method 

Request(HttpRequest req, HttpResponse res, HtpRequest- 

Thread i_httpRequestThread) 
processes an incoming HTTP request req and produces an 
HTTP response res. It does so by stripping out the URL from 
req by means of the method req.get (Http. QUERY), and 
calling GenerateResponse( ) to store the response in a byte 
array byteArrayOutputStream. 

The method 

GenerateResponse(ByteArrayOutputStream out, String 
request) 

parses the string request, extracting region data into a 
rectangle oldRect, dimension data into a dimension dim, and 
region data into a rectangle initRect. Then it counts the 
number of remaining data tokens. If two tokens remain, then 
the server identifies them as image map coordinates, and 
invokes a method Zoomln ( ) to calculate the new rectangle 
newRect. 

If one token remains, then the server identifies it as a user 
command. For a ZOOM JN command, the server invokes 
the method ZoomIn( ), with parameters 0.5,0.5 indicating a 
centered zoom, to calculate a new rectangle newRect. For a 
ZOOM__OUT command, the server invokes a method 
ZoomOut( ) to calculate a new rectangle newRect. For a 
RESET command, the server simply sets newRect to Ini- 
tRect. For a PAN command, the server extracts the pan 
direction from a hash table, and invokes the method Pan( ) 
to calculate a new rectangle newRect. Finally, after newRect 
is determined, a method MakeNewRequest( ) is invoked to 
update the various HTML tags described hereinabove. 

The methods ZoomIn( ), ZoomOut( ) and Pan( ) are 
mathematical routines that carry out the necessary arithmetic 
to derive a new region from an old region in correspondence 
with the selected command. The details of this arithmetic are 
evident in the listing from Appendix B. For clarification, a 
description of one of these three routines, ZoomIn( ), is 
provided hereinbelow, since the other two routines are 
similar. 

ZoomIn( ) takes as input parameters relative coordinates 
i_x and i_y within the view window. These coordinates are 
floating point numerals ranging between 0 and 1. For a 
centered zoom-in, they would each be equal to 0.5. ZoomIn( 
) identifies the quarter-integer of the form k/4 that is nearest 
to i_x, where k is one of the integers 0, 1, 2, 3 or 4. 
Similarly, ZoomIn( ) identifies the quarter integer of the 
form 1/4 that is nearest to i_y, where 1 is one of the integers 
0, 1, 2, 3, or 4. The desired rectangular zoom-in region is the 
one centered at (k/4, 1/4) with a width and height of ¥1 in 



6,283 Bl 

26 

relative scale, relative to the view window. Translating this 
into absolute coordinates, if (x 1? Yj) denotes the lower left 
coordinate of the old rectangular region, and if w and h 
denote the width and height, respectively, of the old rect- 
5 angular region, then the desired rectangular zoom-in region 
is centered at (x 1 +k*w/4, Yj+^h/4) and has width w/2 and 
height 1/2 . 

When k and 1 are each either 1, 2 or 3, then (k/4, 1/4) is 
an interior point, and the rectangular zoom-in region 

10 described hereinabove is guaranteed to he within the bound- 
aries of the full image. However, if k or 1 takes a value of 0 
or 4, then it is possible that the rectangular zoom-in region 
may extend beyond the boundaries of the full image. 
ZoomIn( ) checks for this, and if necessary it shifts the above 

15 calculated rectangular zoom-in region horizontally and/or 
vertically by w/4 and/or 1/4, respectively, in order to keep it 
within the confines of the full image. 

The resulting zoom-in Tegion is thus a sub-region of the 
old rectangular region. When this zoom-in region is dis- 

2Q played at the same pixel resolution as the old region, it gives 
the user the desired effect of having zoomed-in, or 
magnified, by a factor of two, a selected part of the image 
previously displayed. It is apparent to one skilled in the art 
that the zoom-in factor is not required to be two, and can be 

^ set arbitrarily. 

The method MakeNewRequest( ) sets the various HTML 
tags by means of a hash table and invokes a method 
PerformMerge( ) (listing not included) to embed the tags 
into an HTML page, thereby producing the desired byte 

30 array result. 

It will be appreciated by persons skiEed in the art that the 
present invention is very broad, and has many extensions 
beyond those scenarios described hereinabove. It is apparent 
that the present invention is not limited to still images and 

35 panoramas, but applies to other types of multimedia as well. 
For example, it applies to object movies and slide shows, 
whereby the response to a user request made while viewing 
a current frame of the movie or slide show, is to display a 
different frame. 

4Q It is also apparent that the use of sub-regions in the present 
invention can be complemented by or replaced with user 
interface buttons, so that clicking on a specific button 
corresponds to selecting a specific subregion. 
It is also apparent that the present invention applies to 

45 digital image data stored within a single file, or distributed 
among multiple files. 

It will be appreciated by persons skilled in the art that the 
present invention is not limited by what has been particu- 
larly shown and described hereinabove. Rather the present 

50 invention includes combinations and sub -combinations of 
the various features described hereinabove as well as modi- 
fications and extensions thereof which would occur to a 
person skilled in the art and which do not fall within the prior 
art. 

S5 What is claimed is: 

1. A method for archiving digital data on a server 
computer, and enabling a user, by means of a client 
computer, to interactively view a digital image derived from 
said digital data, comprising: 
60 receiving by said client computer from said server com- 
puter an HTML page, said HTML page including a 
view window within which a first image is displayed, 
the first image being a first portion of the digital image; 
selecting by said user, using a pointing device, a com- 
65 mand; 

sending by said client computer to said server computer 
an indication of the command selected by said user; 
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in response to said sending an indication of the selected 
command, dynamically constructing a second image, 
the second image being a second portion of the digital 
image, and the second portion of the digital image 
corresponding to the selected command; 5 

modifying by said server computer, using server-side 
software, the HTML page to generate a new HTML 
page, the new HTML page having a link to the second 
image; and 

sending by said server computer to said client computer 10 
said new HTML page. 

2. A method according to claim 1 and wherein said 
sending by said client computer to said computer also 
includes sending client state information to said server 
computer. 

3. A method according to claim 2 and wherein said client 15 
state information includes the size and location of said view 
window. 

4. A method according to claim 2 and wherein said client 
state information includes an indication of the region within 
said digital image occupied by said first image. 20 

5. A method according to claim 2 and wherein said client 
state information includes an indication of the region within 
said digital image initially occupied by said first image. 

6. A method according to claim 1 and wherein said link to 
the second image is a sequence of commands forming part 25 
of the Internet Imaging Protocol (HP). 

7. A method according to claim 6 and wherein said 
sequence of commands forming part of the IIP includes a 
convert (CVT) command. 

8. A method according to claim 1 and wherein said digital 30 
data is a tiled multi-resolution image file. 

9. A method according to claim 1 and wherein said second 
image is built from tiles within a multi-resolution image file. 

10. Amethod for interactive viewing of a digital image by 

a user, said viewing being controlled by a client computer, 3S 
the method employing digital data residing on a server 
computer and comprising: 

receiving by said client computer from said server com- 
puter a first HTML page, said first HTML page includ- 
ing a view window within which a first image is ^ 
displayed, the first image being a first portion of the 
digital image; 

selecting by said user, using a pointing device, a com- 
mand; 

receiving by said client computer a second HTML page, 45 
generated by said server computer, in response to said 
command which was selected, wherein said second 
HTML page contains a link to a dynamically con- 
structed second image, the second image being a sec- 
ond portion of the digital image, and the second portion 50 
of the digital image corresponding to the selected 
command; and 

repeating said selecting and said receiving of said second 
HTML page at least once, with the second HTML page 
being used in place of the first HTML page in each 55 
successive repetition. 

11. A method according to claim 10 and wherein said 
digital data is a tiled multi-resolution image file. 

12. Amethod according to claim 10 and wherein said link 

to the second image is a sequence of commands forming part 60 
of the Internet Imaging Protocol (HP). 

13. A method according to claim 12 and wherein said 
sequence of commands forming part of the IIP includes a 
convert (CVT) command. 

14. A method according to claim 10 and wherein said 65 
second image is built from tiles within a multi-resolution 
image file. 
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15. Amethod for generating dynamic HTML pages on a 
server computer, to enable a user to interactively view a 
digital image on a client computer, by interactive selection 
of a command by said user, comprising: 

receiving from said client computer an indication of a user 
selected command; 

in response to said receiving an indication of the user 
selected command, dynamically constructing an image, 
the image being a portion of the digital image, and the 
portion of the digital image corresponding to the user 
selected command; 

creating an HTML page containing a link to the image; 
and 

sending said HTML page to said client computer. 

16. A method according to claim 15 and wherein said 
receiving also includes receiving client state information. 

17. Amethod according to claim 15 and wherein said link 
to an image is a sequence of commands forming part of the 
Internet Imaging Protocol (IIP). 

18. A method according to claim 17 and wherein said 
sequence of commands forming part of the IIP includes a 
convert (CVT) command. 

19. A method according to claim 15 and wherein said 
digital image is a tiled multi-resolution image. 

20. A method according to claim 15 and wherein said 
image is built from tiles within a multi -resolution image file. 

21. An archival system for archiving digital data on a 
server computer, and enabling a user, by means of a client 
computer, to interactively view a digital image derived from 
said digital data, comprising: 

a first communication channel for receiving by said client 
computer from said server computer an HTML page, 
said HTML page including a view window within 
which a first image is displayed, the first image being 
a first portion of the digital image, and for subsequently 
sending by said server computer to said client computer 
a new HTML page; 

a pointing device for selecting by said user a command; 

a second communication channel for sending by said 
client computer to said server computer an indication of 
the command selected by said user; and 

at least one processor for dynamically constructing a 
second image, the second image being a second portion 
of the digital image, and the second portion of the 
digital image corresponding to the selected command, 
and for modifying the HTML page to generate said new 
HTML page, the new HTML page having a link to the 
second image. 

22. A system according to claim 21 and wherein said 
second communication channel is also used to send client 
state information to said server computer. 

23. A system according to claim 22 and wherein said 
client state information includes the size and location of said 
view window. 

24. A system according to claim 22 and wherein said 
client state information includes an indication of the region 
within said digital image occupied by said first image. 

25. A system according to claim 22 and wherein said 
client state information includes an indication of the region 
within said digital image initially occupied by said first 
image. 

26. A system according to claim 21 and wherein said link 
to a second image is a sequence of commands forming part 
of the Internet Imaging Protocol (IIP). 

27. A system according to claim 26 and wherein said 
sequence of commands forming part of the IIP includes a 
convert (CVT) command. 
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28. A system according to claim 21 and wherein said 
digital data is a tiled multi-resolution image file. 

29. A system according to claim 21 and wherein said 
second image is a tiled multi-resolution image file. 

30. A client viewing system for interactive viewing of a 
digital image by a user, said viewing being controlled by a 
client computer, employing digital data residing on a server 
computer, comprising: 

a communication channel for receiving by said client 



37. A system according to claim 35 and wherein said link 
to the image is a sequence of commands forming part of the 
Internet Imaging Protocol (IIP). 

38. A system according to claim 37 and wherein said 
sequence of commands forming part of the IIP includes a 
convert (CVT) command. 

39. A system according to claim 35 and wherein said 
digital image is a tiled multi-resolution image. 

40. A system according to claim 35 and wherein said 



computer from said server computer a first HTML 10 image is built from tiles within a multi-resolution image file 



page, said first HTML page containing a view window 
within which a first image is displayed, the first image 
being a portion of the digital image; 

a pointing device for repeatedly selecting by said user a 
command; and 

a communication channel for repeatedly receiving by said 
client computer a second HTML page, generated by 
said server computer, in response to a selected 
command, wherein said second HTML page contains a 
link to a dynamically constructed second image, the 
second image being a second portion of the digital 
image, and the second portion of the digital image 
corresponding to said selected command, and wherein 
the second HTML page is used in place of the first 
HTML page when the pointing device is next used to 
select a command. 

31. A system according to claim 30 and wherein said 
digital data is a tiled multi-resolution image file, 

32. A system according to claim 30 and wherein said link 
to the second image is a sequence of commands forming part 
of the Internet Imaging Protocol (HP). 

33. A system according to claim 32 and wherein said 
sequence of commands forming part of the IIP includes a 
convert (CVT) command. 

34. A system according to claim 30 and wherein said 
second image is built from tiles within a multi-resolution 
image file. 

35. A server dynamic HTML system for generating 
dynamic HTMLpages on a server computer, to enable a user 
to interactively view a digital image on a client computer, by 
interactive selecting of commands by said user from among 
a plurality of commands, comprising: 

a first communication channel for receiving from said 
client computer an indication of a user selected com- 
mand; 

at least one processor for dynamically constructing an 
image, the image being a portion of the digital image, 
and the portion of the digital image corresponding to 
said user selected command, and for creating an HTML so 
page containing a link to the image; and 

a second communication channel for sending said HTML 
page to said client computer, said at least one processor 
being coupled to said first communication channel and 
to said second communication channel. 

36. A system according to claim 35 and wherein said first 
communication channel is also used to receive client state 
information. 
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41. A method for archiving digital data on a server 
computer and enabling a user to interactively view a digital 
image derived from said digital data, comprising: 

receiving from said server computer a first layout con- 
taining a view window within which a first image is 
displayed, the first image being a first portion of the 
digital image; 

selecting by said user, using a pointing device, a com- 
mand; 

in response to said selecting, dynamically constructing a 
second image, the second image being a second portion 
of the digital image, and the second portion of the 
digital image corresponding to the command selected 
by said user; and 

providing by said server computer to said user, using 
server-side software, a second layout, generated by said 
server computer by modifying the first layout, the 
second layout containing a reference to the second 
image. 

42. A method according to claim 41 and wherein said 
digital data is a tiled multi-resolution image file. 

43. A method according to claim 41 and wherein said 
reference to the second image is a reference to a multi- 
resolution image. 

44. A system for archiving digital data on a server 
computer and enabling a user to interactively view a digital 
image derived from said digital data, comprising: 

apparatus providing a first layout containing a view 
window within which a first image is displayed, the first 
image being a first portion of the digital image; 

a pointing device for selecting by said user a command; 

apparatus dynamically constructing a second image, the 
second image being a second portion of the digital 
image, and the second portion of the digital image 
corresponding to the command selected by said user; 
and 

apparatus providing a second layout, generated by said 
server computer, using serverside software, by modi- 
fying the first layout, the second layout containing a 
reference to the second image. 

45. A system according to claim 44 and wherein said 
digital data is a tiled multi-resolution image file. 

46. A system according to claim 44 and wherein said 
reference to the second image is a reference to a multi- 
resolution image. 
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